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1  Introduction 

The  following  is  the  Project  Summary  from  the  original  proposal: 

The  proposed  research  is  to  develop  set- valued -methods  for  robust  nonlinear  control, 
where  “nonlinear  control”  refers  to  nonlinear  controllers  for  both  linear  and  nonlinear 
systems.  Set-valued  methods  represent  a  natural  framework  for  incorporating  uncer¬ 
tainty  into  control  system  analysis  and  design.  Uncertainty  may  come  from  unknown 
parameters,  bounded  disturbances,  neglected  dynamics,  or  uncertain  state  values.  In  a 
set-valued  setting,  system  dynamics  become  set-valued,  state  estimates  are  set-valued, 
and  feedback  controls  become  set-valued.  The  proposed  research  is  to  explore  the  util¬ 
ity  of  set-valued  methods  in  the  specific  areas  of  (1)  output  feedback  control  of  systems 
with  saturations,  (2)  decentralized  control,  (3)  nonlinear  gain-scheduled  control  design, 

(4)  adaptive  control,  and  (5)  control  of  hybrid  dynamical  systems.  A  primary  objective 
throughout  is  the  explicit  computational  construction  of  control  laws  which  guarantee 
achievable  optimal  performance. 

The  set-valued  approach  is  sufficiently  diverse  to  accommodate  the  formulation  of  a  variety  of 
control  problems.  The  computational  burden  associated  with  set-valued  methods  can  be  significant, 
involving  the  solution  of  relatively  small  linear  programs  many  times  over.  The  spirit  of  the  project 
has  been  to  exploit  computational  power  so  that  the  design  and  implementation  of  set-valued 
methods  can  be  a  reality. 

2  Research  Progress 

The  following  describes  the  main  research  results  over  the  funding  period  April  1997  through 
December  1998. 

'Now  with  Mechanical  and  Aerospace  Engineering,  UCLA,  Los  Angeles,  CA,  90095 
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2.1  Output  Feedback  for  Systems  with  Constraints 

An  important  issue  in  control  systems  is  that  of  state  and  control  constraints.  Control  constraints 
take  the  form  of  actuator  saturations  and  rate  limiters.  State  constraints  may  be  imposed  by 
modeling  issues  (e.g.,  remaining  in  a  desired  operating  region  over  which  a  linear  model  is  suitable) 
or  by  performance  considerations  (e.g.,  satisfying  a  tracking  error  bound). 

There  are  a  variety  of  control  strategies  which  address  systems  with  constraints,  including 
heuristic  mechanisms,  such  as  integrator  anti- windup,  controller  scheduling/ switching,  and  receding 
horizon  control.  It  is  possible  to  provide  sufficient  conditions  under  which  various  strategies  can 
meet  imposed  constraints. 

In  this  work,  we  considered  the  following  unsolved  problem: 

Given  a  set  of  state  and  control  constraints,  does  there  exist  any  output  feedback  con¬ 
troller  which  can  satisfy  the  imposed  constraints. 

This  question  addresses  the  problem  of  constraints  at  face  value.  Note  that  no  underlying  control 
structure  is  imposed  a  priori. 

In  the  case  of  discrete-time  scalar  control  problems,  we  were  able  to  provide  a  computationally 
constructive  solution  to  this  problem.  The  system  under  consideration  takes  the  form 

x{k  +  1)  =  Ax(k)  +  B\d{k)  +  S2u(fc) 

z(k)  =  C\x(k)  +  Dud(k)  +  D\2u(k) 
y(k )  =  C2x(k)  +  n(k) 

where  u  is  the  control  input,  y  is  the  measured  output,  and  d  and  n  are  process  disturbances  and 
measurement  noises,  respectively.  The  control  objective  (which  can  be  used  to  impose  state  and 
control  constraints)  is  to  maintain  \z(k)\  <  zma.x  in  the  presence  of  disturbances  and  noises  which, 
after  normalization,  satisfy  |d(/c)|  <  1  and  |n(A:)  j  <  1. 

By  developing  the  Pi’s  work  in  the  state-feedback  case  and  work  in  set-valued  observers,  we  de¬ 
rived  computational  tests  which  determine  whether  any  controller  can  meet  prescribed  constraints. 
Furthermore,  we  showed  that  the  controller  can  be  taken  to  be  a  set- valued  observer  (SVO)  followed 
by  a  static  selection  function. 

A  SVO  produces  a  set  of  state  estimates,  x(k)  €  X(h),  which  are  consistent  with  a  measured 
output  trajectory.  If  the  actual  state  were  known,  then  existing  state-feedback  results  can  be  used 
to  produce  a  set  of  admissible  control  values,  u(k)  €  R{x{k)),  which  assure  that  the  performance 
objective  is  achieved.  Since  the  state  is  unknown,  the  control  must  satisfy 

u(k)e  n  R(0 

fex(fc) 

Computational  tests  were  derived  which  assure  that  the  above  intersection  is  never  empty,  which 
in  turn  implies  that  under  output  feedback,  the  performance  objective  is  achieved  and  hence  the 
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constraints  are  not  violated.  If  these  tests  fail,  then  no  controller  can  achieve  the  desired  perfor¬ 
mance. 

2.2  Scheduling  Nonlinear  Controllers 

In  traditional  gain-scheduling,  a  global  nonlinear  controller  is  pieced  together  using  linear  control 
designs  based  on  fixed  operating  conditions.  In  some  cases,  it  may  be  advantageous  to  used  non¬ 
linear  controllers  even  for  the  fixed  operating  condition  designs.  For  example,  it  may  be  that  a 
linearized  plant  is  not  controllable.  Alternatively,  some  control  strategies  produce  nonlinear  con¬ 
trollers  for  linear  systems  (in  particular,  set- valued  methods). 

This  work  considered  gain-scheduling  in  which  a  global  nonlinear  controller  is  pieced  together 
using  local  nonlinear  controllers.  A  potential  advantage  of  using  nonlinear  controllers  is  to  alleviate 
two  of  the  main  limiting  factors  in  traditional  gain-scheduling,  namely  rapid  transitions  among 
operating  conditions  and  neglected  nonlinearities. 

The  Pi’s  earlier  work  on  set- valued  methods  for  linear  parameter  varying  (LPV)  systems  ad¬ 
dressed  systems  of  the  form 

x(k  +  1)  =  A{6(k))x(k)  +  B\d(k)  +  B2{0(k))u(k) 

z{k )  =  Ci{0{k))x(k)  +  Dud{k )  +  D\2u{k ) 

\0{k  +  1)  -  9{k)\  <p 

The  objective  is  to  maintain  |.?(A:)|  <  zmax  in  the  presence  of  disturbance  |d(/j)|  <  1-  The  variable 
0  is  an  exogenous  parameter  whose  rate  of  variation  is  bounded  by  p.  Using  set-valued  methods, 
it  is  possible  to  construct  nonlinear  parameter  dependent  state  feedback  u(k)  —  g(x(k),6(k))  to 
achieve  the  desired  minimization. 

LPV  dynamics  form  the  underlying  basis  of  gain-scheduling  with  two  major  differences:  1)  the 
“parameter”  is  actually  an  endogenous  variable  and  2)  the  state  dynamics  include  high  order 
nonlinearities.  It  is  often  possible  to  write  the  dynamics  in  the  form 

0(k  +  1)  =  6(k)  +  E(0{k))x(k) 

x(k  +  1)  =  A{6(k))x(k)  +  Bid{k)  +  B2{9{k))u{k)  +  Hv(k) 
z(k)  =  Ci(6{k))x(k)  +  D\\d{k)  +  D\2u{k) 

where  v(k)  is  an  artificial  disturbance  which  represents  high-order  nonlinearities  such  that 

M*0I  <  7*  M*0I2 


provided  that 


\Fx(k)\  <  1 


It  is  possible  to  use  previous  results  on  LPV  systems  as  follows: 


3 


•  Treat  9(k)  as  an  "exogenous"  parameter. 

•  Assume  \9{k  +  1)  -  9{k)\  <  p  for  some  p. 

•  Impose  \E(9{k))\  <  p  in  the  design. 

•  Include  an  artificial  disturbance  v{k). 

•  Impose  \Fx(k)\  <  1  in  the  design. 

In  this  manner,  transition  rates  between  operating  conditions  as  well  as  high  order  nonlineari¬ 
ties  are  included  in  the  design  process— at  the  cost  of  increased  computational  requirements  and 
possible  conservatism.  If  the  LPV  control  construction  algorithm  converges,  then  one  obtains  a 
nonlinear  gain-scheduled  controller  u{k )  =  g(9(k),x{k))  which  is  guaranteed  to  achieve  the  desired 
performance.  Unlike  traditional  gain-scheduling,  stability  and  performance  is  built  into  the  design 
process,  thereby  alleviating  the  need  for  extensive  evaluative  simulations. 

Another  research  result  addressed  the  stability  of  the  nonlinear  system 

x(k  +  l)  =  f(x(k),d(k),9(k)) 

and  showed  that  input-output  stability  for  9{k)  “frozen”  implies  input-output  stability  for  9(k) 
slowly  varying.  Unlike  classical  results  from  differential  equations,  this  work  did  not  assume  expo¬ 
nential  stability  in  case  9{k)  is  frozen,  thereby  admitting  the  possibility  of  nonlinear  controllers  for 
systems  whose  linearizations  are  not  controllable. 

2.3  Adaptive  Control  with  Guaranteed  Transient  Bounds 

An  important  issue  in  adaptive  control  is  the  transient  behavior  during  the  “identification”  phase 
in  which  a  parameter  estimator  seeks  to  identify  actual  parameter  values.  This  work  considered 
the  utility  of  set-valued  methods  in  the  preliminary  state-feedback  case. 

The  system  dynamics  take  the  form 

x{k  +  1)  =  Ax{k)  +  B^d{k )  +  B2u{k)  +  E(x(k))9(k) 

9(k  +  1)  =9{k) 

z(k)  =  C\x(k)  +  Dnd(k)  +  D\2u(k) 

where  9{k)  is  a  vector  of  constant  unknown  parameters.  The  objective  is  to  maintain  \z(k)\  <  2max 
in  the  presence  of  disturbance  \d(k)\  <  1. 

In  this  work,  we  combined  methods  for  set-valued  state  feedback  and  SVO’s  to  produce  a 
sequence  of  parameter  independent  feedback  laws  u(k)  =  gi(x(k))  which  assure  that  \z(k)\  <  zmax,i> 
where  zmax,i  is  a  sequence  of  progressively  more  stringent  performance  bounds. 

Set-valued  tools  turn  out  to  be  well  suited  for  this  problem.  The  unknown  parameter  vector  is 
assumed  to  lie  initial  in  some  set  0(0).  Set-valued  tools  for  LPV  systems  can  be  used  to  design  a 
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state  feedback  u(k)  =  g0{x(k))  which  assures  \z{k)\  <  zmax, o  for  all  time-varying  6  €  0(0).  As  the 
system  evolves,  a  SVO  can  be  used  to  construct  progressively  shrinking  sets  Q{k)  which  contain 
the  “true”  parameter  vector.  Whenever  @(k\)  reflects  significant  parameter  identification,  a  new 
feedback  law,  u(k)  =  g\(x(k ))  is  constructed  which  assures  |z(/c)|  5;  ^max,i  for  all  time-varjing 
6  S  0(fci). 

The  procedure  continues  by  designing  a  feedback  law  u{k)  =  gi[x{k))  which  assures  |~(fc)|  ^ 
zma x,t  for  all  time-varying  9  €  Q(ki).  At  all  times,  the  state  magnitudes  are  kept  in  check  by  using 
an  “uncertainty  equivalence”  feedback  which  assures  performance  over  an  uncertain  parameter  set, 
as  opposed  to  a  certainty  equivalence  controller  which  simply  employs  the  parameter  estimate  in  a 
parameter-dependent  feedback  law. 

2.4  Receding  Horizon  for  Systems  with  Constraints 

A  primary  motivation  for  receding  horizon  control  is  the  existence  of  state  and  control  constraints. 
Receding  horizon  control  uses  on-line  optimization  of  a  finite-horizon  objective  to  construct  a 
feedback  law.  For  linear  systems  with  quadratic  or  piecewise  linear  objective  functions,  state  and 
control  constraints  can  easily  be  included  in  the  on-line  optimizations.  One  major  difficulty  is 
whether  satisfying  the  constraints  over  the  specified  finite-horizon  implies  that  the  constraints  can 
be  satisfied  over  the  infinite-horizon  future. 

It  is  possible  to  combine  set-valued  methods  with  receding  horizon  control  to  alleviate  this 
difficulty.  The  system  under  consideration  is 

x(k  +  1)  =  Ax(k)  +  Bu(k) 


z(k)  =  Cx(k)  +  Du(k) 


The  receding  horizon  cost  function  is 


k+N 


min 

u(k),...,u(k+N) 


M*(0>«(*)) 

i—k 


subject  to  the  constraint  \z(k)\  <  1.  Here,  h{x,u)  is  a  penalty  function  which,  for  computational 
purposes,  can  be  quadratic  or  piecewise  linear.  The  above  optimization  leads  to  an  control  sequence 
{u*{k), ...  ,u*(k  +  N)}.  Let  ^rh(^)  denote  the  mapping  from  x(k)  to  u*(k).  Then  the  receding- 
horizon  feedback  law  is  u(k )  =  0rh  {x{k)).  which  amounts  to  implementing  only  the  first  element 
of  the  optimal  control  sequence. 

The  problem  with  the  above  procedure  is  that  it  may  not  be  possible  to  compute  an  optimal 
control  sequence  {u*(k), . . .  ,u*(k  +  N)}  which  satisfies  the  constraints  |z(fc)|  <  1.  By  using  set¬ 
valued  methods,  one  can  translate  the  desired  infinite-horizon  constraint  \z(k)\  <  1  to  a  pointwise- 
in-time  constraint,  |z(fc)|  <  1,  where 


z(k)  =  Cx(k)  +  Du(k) 
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for  appropriate  C  and  D.  The  advantage  here  is  that  |z(fc)|  <  1  implies  1)  \z{k)\  <  1  and 
2)  | z(k  +  1)|  is  possible. 

The  above  ideas  were  developed  to  produce  a  receding  horizon  computational  scheme  which 
guarantees  infinite-horizon  feasibility  of  constraints,  has  guaranteed  stability  properties,  and  ap¬ 
proximates  the  optimal  infinite  horizon  policy. 

This  work  prompted  a  new  direction  of  research  regarding  stochastic  manufacturing  lines. 

2.5  Computational  Capabilities  and  Simulation  Studies 

Set-valued  methods  are  computationally  intensive  and  likely  to  be  applicable  to  low  order  systems 
only.  However,  with  ever  increasing  computational  power,  the  interpretation  of  low  order  changes. 
Furthermore,  the  standard  engineering  practice  of  breaking  down  high  order  problems  into  collec¬ 
tions  of  low  order  problems  is  especially  amenable  to  set-valued  methods  because  of  the  guaranteed 
magnitude  bounds  set-valued  methods  provide. 

The  following  simulation  studies  have  been  conducted  over  the  course  of  this  project: 

•  Missile  Autopilot  via  LPV  gain-scheduling  with  rapid  changes  in  angle-of-attack  and  ac¬ 
tuator  constraints. 

•  Compressor  combustion  control  via  LPV  gain-scheduling  with  compressor  characteristic 
uncertainty. 

•  Boiler-turbine  control  via  LTI  set-valued  methods  with  state  constraints  and  actuator 
constraints. 

•  VTOL  aircraft  control  via  LPV  gain-scheduling. 

•  Manufacturing  system  scheduling  via  receding-horizon  control  with  state  constraints  and 
actuator  constraints. 
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